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Abstract 

In recent years the needs of ground-based 
rcscarchcr-analysts to access real-time engineering 
data in the form of processed information has ex- 
panded rapidly. Fortunately, the capacity to deliver 
that information has also expanded. The development 
of advanced display systems is essential to the suc- 
cess of a research test activity. Those developed at 
the National Aeronautics and Space Administration 
(NASA), Western Aeronautical Test Range (WATR), 
range from simple alphanumerics to interactive map- 
ping and graphics. These unique display systems are 
designed not only to meet basic information display 
requirements of the user, but also to take advantage 
of techniques for optimizing information display. Fu- 
ture ground-based display systems will rely heavily not 
only on new technologies, but also on interaction with 
the human user and the associated productivity wilh 
that interaction. The psychological abilities and limi- 
tations of the user will become even more important in 
defining the difference between a usable and a useful 
display system. This paper reviews the requirements 
lor development of real-time displays; the psychologi- 
cal aspects of design such as the layout, color selection, 
real-time response rate, and interactivity of displays; 
and an analysis of some existing WATR displays. 

Nomenclature 

MCC mission control center 

NASA National Aeronautics and Space 

Administration 

‘Assistant Professor. 

•Manager, Western Aeronautical Test Range. 

This paper is declared a work of the U.S. Government and 
is not subject to copyright protection in the United States. 


PC personal computer 

STM short-term memory 

WATR Western Aeronautical Test Range 

Introduction 

The success of NASA aeronautics programs is di- 
rectly related to Western Aeronautical Test Range 
(WATR) ability to refine and advance techniques that 
support research flight and ground test requirements. 
Requirements to acquire, process, and display im- 
mense quantities of data will continue to challenge the 
development of real-time interactive display systems. 
Innovative system designs at Ames Research Center, 
Dryden Flight Research Facility have provided a ca- 
pability for information display that will continue to 
push the limits of technology. 

The primary mission of WATR is to provide the 
capability to conduct aeronautical research missions 
through the development and operation of tracking and 
data acquisition systems, real-time processing and dis- 
play systems, and audio and video communications 
systems (Fig. 1). This support uses a combination of 
facilities in California: Ames Research Center, Mof- 
fett Field; Dryden Flight Research Facility, Edwards 
Air Force Base; and Naval Auxiliary Landing Field, 
Crows Landing, Patterson. In addition to these facil- 
ities, mobile research flight test support systems are 
available for use at remote locations. 

The data resulting from flight and ground test mis- 
sions are processed through a sophisticated computer 
system and is then sent to mission control center 
(MCC) facilities for display in real time. These real- 
time data displays are crucial to the safe and effec- 
tive completion of various flight missions. This has 



led the WATR to continue its leadership role in the de- 
velopment and implementation of new display tech- 
nologies appropriate for use in research flight and 
ground testing. 

While many of the displays presented in this paper 
are oriented toward flight lest, their basic design and 
function is relevant to a much broader range of appli- 
cations. Thus, our discussion of this work will attempt 
to capture some of this breadth, rather than focusing 
on more specific applications. 

Information Requirements 

The implementation goal is to develop generic dis- 
play systems capable of supporting a full range of test 
requirements for a variety of test missions. Conse- 
quently, these display systems must have the capabil- 
ity to present a variety of information and display for- 
mats. Ideally, all information required to determine the 
results and success of the test arc transmitted to the dis- 
play system in real-time, reducing postmission analy- 
sis requirements. 

Display systems for support of research flight and 
ground testing can be divided into broad areas: safety 
of personnel, equipment, and the test article; produc- 
tivity in test envelope expansion; real-time optimiza- 
tion of the research test; and maximum scientific return 
from the research test. The method of presentation, 
amount of information presented, and display interac- 
tivity have different characteristics depending on the 
purpose of the display. 

The most important step in the development of new 
display technology is to have a clear understanding 
of the required test objective including the real-time 
and postmission analysis requirements. Figure 2 dis- 
plays the evolution of requirements for WATR support. 
Real-time display requirements are analy/xd to deter- 
mine the appropriate approach for the desired informa- 
tion transfer. Only after completing this analysis is the 
new display capability developed. 

Within the WATR well over 1500 missions, both 
ground tests and airborne research flight tests, are con- 
ducted each calendar year. Each of these tests has 
distinctive display requirements or classes of require- 
ments. Schedules may require implementation of new 
displays within 2 days, while 6 months may be needed 
for the more complex. It is not practical or cost ef- 
fective to develop an entirely new display capability 
for each test. A generic display capability that can 
interactively be customized by the user in real time 


would save both time and money in display develop- 
ment. The WATR development team must continually 
anticipate future display requirements to determine the 
path for development of new display systems. 

Psychological Factors in Design 

Test results must be displayed in a form that can be 
easily assimilated by the user in real time. To do other- 
wise places an unneeded mental processing burden on 
the user. This additional mental processing burden has 
the potential of making the researcher less efficient. A 
decrease in efficiency in one part of the information 
analysis system reduces the effectiveness of the entire 
test program. 

Based on this need, there is an increasing require- 
ment to design display systems that better fit the inher- 
ent information processing (psychological) capabili- 
ties of the user, rather than requiring that the user con- 
form to the display portion of the system. This interest 
has been translated into an examination of how dis- 
play design affects memory load and ease of learning. 
In addition, factors such as color perception and use, 
and cognitive processing ability are being examined 
in order to determine how they should influence dis- 
play design. 

Memory Load 

Memory load can be a critical factor in the real-time 
environment of the MCC. The most critical form of 
memory in this setting is human short-term memory 
(STM). 1 > 2 The generally acknowledged storage capac- 
ity of STM is 7 ± 2 chunks of information. When 
combined with other attention-demanding tasks, as in 
the MCC, STM capacity will generally be towards the 
low end of this range. Once the capacity of STM is 
exceeded, some of the information stored in STM will 
be lost or forgotten. Depending on the nature of the 
forgotten information, this forgetting can produce any- 
thing from a minor inconvenience to a catastrophe. 

The concern over memory load has become more 
relevant as aircraft design, system design, and research 
test programs have become more complex. Increased 
complexity has lead to increased demands on STM 
during research flight and ground testing. Thus, it has 
become necessary to redesign displays to reduce the 
load on STM. 

Color Perception 

With the inclusion of increasingly sophisticated dis- 
plays that use color, color perception and color use 
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need to be considered. It should be remembered that 
color perception is a psychological as well as a phys- 
iological process. The most obvious example of this 
involves cultural stereotypes for color use. In most 
western cultures red is used for warning or stop, while 
green is used for O.K. or go. Use of these colors in a 
manner that violates these norms will cause confusion 
and errors on the part of the user. Again, the nature 
of the information displayed will determine the cost of 
these errors. 

While humans can discriminate a fairly large num- 
ber of colors under laboratory conditions (approxi- 
mately 200), this discrimination ability docs not gen- 
erally transfer to application utility. 3 The discrimina- 
tion between two similar shades of the same color 
is fairly easy when those are the only two col- 
ors being displayed and they are adjacent to each 
other. In an application where these colors are sep- 
arated by distance and other colors, this discrimi- 
nation is very often beyond the perceptual capabil- 
ity of the typical human user. Thus, coding dis- 
crete information using similar colors will generally 
be ineffective. 

Cognitive Processing 

One must also be concerned with cognitive process- 
ing, or how people process the information they lake 
in. This includes a number of seemingly different ar- 
eas of concern. These differences include recognition 
and recall, alphanumerics and graphics, and how peo- 
ple learn. All of these factors and more fall under the 
heading of cognitive processing. 

These factors, especially memory load and cogni- 
tive processing, combine to make formatting of the dis- 
play an issue that needs to be considered. Formatting 
includes two primary factors. The first is the type of 
data display, alphanumerics or graphics. Depending 
on the type of information to be displayed, one of these 
will generally be superior to the other. 

The second factor in formatting would be character 
dcasity. The more characters that arc included in the 
display, the longer it takes for a person to locate the 
information desired. Thus, unnecessary information 
on a display is not as harmless as is often thought. 

One other design factor that must be considered in 
light of memory load and cognitive processes is the 
interactivity of the display device. With improving 
technology, the display devices presenting data to the 
researcher no longer need to be strictly passive. As 
seen later, many of these devices will allow the user to 


change display formats or change the information dis- 
played during the actual testing phase. When properly 
implemented, this interactivity can be a boon to the re- 
searcher. By allowing the researcher to choose only 
relevant information, screen density can be reduced. 
However, this also brings with it the danger of the user 
producing inefficient displays, displays of high char- 
acter density, or cognitive overload by thinking about 
changes during the testing program. 

Without proper consideration for these human fac- 
tors, the display systems can be designed in a manner 
that reduces the user’s performance by presenting in- 
formation in a manner not conducive to efficient and 
effective processing by the user. 

Display Analysis 

The creation of optimal displays requires that some 
form of analysis be performed. Four basic methods 
exist for determining the usefulness of a display de- 
sign: judgment of the programmer, user feedback, ex- 
pert opinion, and research. Information from the last 
three methods will generally be most useful when used 
in combination. 

Expert opinion generally provides a reasonable ini- 
tial display design. This opinion might be gained by 
use of an on-site expert, an outside consultant, or a set 
of printed guidelines. User feedback can enhance the 
design by noting major design flaws. Unfortunately, 
the user, while able to locate problems, will not always 
come forth with a usable solution to the design flaw. 
That brings us back to the expert, who must now make 
a judgment as to how the flaw should be corrected. 

Research in the actual mission control center envi- 
ronment will further enhance this process in two ways. 
First, design flaws that would not be major enough 
for user comment could be uncovered. Second, expert 
opinion may be enhanced by allowing for the compar- 
ison of likely alternatives. This research, coupled with 
expert opinion and attention to user comments, should 
provide for the design of an optimal display. To review 
this design process, some existing WATR displays will 
be analyzed. Figure 3 shows a variety of displays in 
use in the WATR. 

In general, any display can be analyzed for usability 
by considering several factors: 

1. Is there sufficient information on the display? 

2. Is there any excessive information on the display? 
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3. Would reformatting the information help? 

4. Would graphics or some other presentation for- 
mat be better? 

5. Would color be useful for this display? 

6. What is the appropriate use for color in this dis- 
play? 

7. Does the display place any unnecessary memory 
demands on the user? 

8. Would interactivity benefit the user? 

Any or all of these factors may need to be considered 
when developing or revising displays of engineering 
data or safety information. 

The display depicted in Fig. 4 can be used as an ex- 
ample of how the design process might work. This 
fairly common alphanumeric display of engineering 
data is a usable display, though not optimal. It con- 
tains all the information necessary but not in a format 
well-suited for transfer to the user. 

So how might this display be optimized? We can be- 
gin by soliciting user comments for this already func- 
tioning display. In this particular case, the display is 
not sufficiently bad to prompt many user comments. 

The next step would be to solicit expert opinion. For 
this display, the immediate goal would be to reformat 
the upper half of the display so that character density 
is reduced, and quantities that need to be compared arc 
placed next to each other. One such option for doing 
this can be seen in Fig. 5. 

At this point, we can either go back to the users and 
see if there are any comments, or we can move into 
the laboratory to see if we have actually made any im- 
provements. Since this particular display system has 
already been implemented, research will be our best 
option. This reduces the number of changes prior to 
final implementation. 

Once the upper half of the screen has been consid- 
ered, we may move to the lower half (Fig. 4). The 
purpose of this portion of the screen is to provide 
the user with information concerning behavior across 
time. This same information could be displayed more 
compactly and with less demand on human processing 
by using either graphics or moving averages (Fig. 6). 

Finally, we can examine this screen for interactive 
compatibility. While the actual use of this display is 


currently a noninteractive one, there is no technologi- 
cal reason that the user should not be allowed to modify 
it. Modifications can be allowed in real time, or before 
the start of a given test program. 

Interactivity could fail if the users lack understand- 
ing of human factors issues. The most likely failure 
would be users placing too much unneeded informa- 
tion on the screen, thus reducing the overall effective- 
ness of the display. Another possible negative result 
would occur if the user were allowed to override the 
established formatting conventions. 

Once these display modifications have been fully 
implemented and tested in the laboratory, they can be 
used on a trial basis. Assuming that this trial imple- 
mentation does not uncover any unforseen problems, 
final implementation can proceed. 

Color use is another consideration in analyzing dis- 
plays. Figures 7 and 8 illustrate two examples of color 
use. Figure 7 depicts a safety display that mimics im- 
portant warning lights in the cockpit. This display 
makes significant use of color by indicating active or 
inactive systems status, as well as unsafe conditions. 
Whenever the status of a particular system changes, 
so does the color of the block associated with that 
system. Thus, color change, which is an attention- 
grabbing phenomenon, means that something impor- 
tant is happening. The safety officer can very quickly 
use this display to double check that all necessary sys- 
tems are indeed operating by looking for the corre- 
sponding green lights. When one of the panels changes 
from green or gray to yellow or orange, the safety of- 
ficer’s only decision is who to inform of the problem. 

Figure 8 is a color graphics display for engineering 
data. Color has been used in a number of cases where 
it fails to serve any functional purpose. In such a case 
color acts as a distractor. That is, it draws the user’s 
attention away from what should be the focus of the 
display. This is because humans have learned to use 
color as a significant form of coding information (for 
example, traffic lights). In this case, the user will prob- 
ably adapt and screen out the distractions. Because of 
this, two points need to be made. The first is that the 
screening process takes some level of mental process- 
ing ability away from an already demanding task. The 
second is that, should this type of color contamination 
appear in a display where color coding is informative, 
the user will tend to screen out the useful information 
right along with the useless. Color ends up becoming 
the proverbial boy who cried wolf. 
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For this display, real-time modifications by the user 
arc allowed. Ideally, this will allow the user to add 
or eliminate individual plots and data displayed on the 
plots as the needs of the test program change across 
time. Of course, the possibility of the user trying to 
place too much information on the display still re- 
mains. This has been curbed somewhat by placing lim- 
its on how many plots may be on a single display. This 
limit will force the user to consider which information 
is truly useful. 

Concluding Remarks 

It is important that the WATR continue to push the 
limits of technology and innovation in order to keep 
pace with increasingly more complex aircraft, sys- 
tems, and their test programs. This has already man- 
dated the development of advanced techniques for op- 
timizing information display systems. Future devel- 
opment must continue to incorporate techniques out- 
lined in this paper and develop additional techniques 
to enhance the human-machine interface related to dis- 
play technology. 

Display system augmentations will include several 
options that are not yet considerations in display devel- 
opment. More processing capability will reduce some 
of the technological bottlenecks that exist in today’s 
systems, while allowing for even more sophisticated 
display design. Greater interactivity may be allowed 
as technology improves and the benefits and limita- 
tions of interactivity become better understood. Intro- 
duction of PC systems with increased processing and 
display capability will not only allow interactivity, but 
also the ability of the users to provide their own off- 
the-shelf or customized display software. And finally, 
improved methods will network all the necessary hard- 


ware into a single, cohesive unit that is transparent to 
the user. 

Development of advanced displays will continue to 
challenge the delicate balance between human and ma- 
chine. Human-machine interaction needs to be clearly 
understood to design and develop display systems that 
will enhance the information transfer process. With 
efficient information transfer, real-time ground and 
flight test results can be obtained that are cost effective 
and productive. 

Development of advanced real-time display systems 
is crucial for safe and effective completion of research 
ground and flight test activities. The WATR continues 
to emphasize the role that human-machine information 
transfer technology plays in this development. The 
formation of new techniques to enhance information 
transfer related to real-time interactive display systems 
is essential in development of new display technolo- 
gies. The success of NASA’s aeronautics programs 
is directly related to the WATR’s ability to refine and 
advance techniques for support of research flight and 
ground testing. 
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Fig. 2 Evolution of aeronautical program requirements. 
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Fig. 3 Mission control room. 
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Fig. 4 Alphanumeric display. 
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Fig. 5 Matching items in adjacent columns. 
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Fig. 6 Substituting moving averages for periodic updates. 
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Fig. 7 Real-time data to mission control center displays. 
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Fig. 8 Master graphics interactive console display. 






AJASA^ Report Documentation Page 

S(XCe A<Jmn«|ralcn 


1. Report No. 2. Government Accession No. 

NASA TM- 100450 


4. Title and Subtitle 

Techniques for Optimizing Human-Machine Information 
Transfer Related to Real-Time Interactive Display 
Systems 


7. Author! s) 

Michael M. Granaas and Donald C. Rhea 


| 9. Performing Organization Name and Address 
NASA Ames Research Center 
Dryden Flight Research Facility 
P.O. Box 273, Edwards, CA 93523-5000 


12. Sponsoring Agency Name and Address 

National Aeronautics and Space Administration 
Washington, DC 20546 

IS. Supplementary Notes 


3. Recipient's Catalog No. 


5. Report Date 
January 1989 


6. Performing Organization Code 


8. Performing Organization Report No. 

H-1506 


10. Work Unit No. 


RTOP-3 14-50-20 


11. Contract or Grant No. 


13. Type of Report and Period Covered 

Technical Memorandum 

14. Sponsoring Agency Code 


Prepared as AIAA 89-0151 for presentation at AIAA 27th Aerospace Sciences Meeting, Reno, Nevada, 
January 9-12, 1989. 


16. Abstract 

In recent years the needs of ground-based researcher-analysts to access real-time engineering data in the 
form of processed information has expanded rapidly. Fortunately, the capacity to deliver that information 
has also expanded. The development of advanced display systems is essential to the success of a research 
test activity. Those developed at the National Aeronautics and Space Administration (NASA), Western 
Aeronautical Test Range (WATR), range from simple alphanumerics to interactive mapping and graphics. 
These unique display systems are designed not only to meet basic information display requirements of the 
user, but also to take advantage of techniques for optimizing information display. Future ground-based 
display systems will rely heavily not only on new technologies, but also on interaction with the human user 
and the associated productivity with that interaction. The psychological abilities and limitations of the user 
will become even more important in defining the difference between a usable and a useful display system. 
This paper reviews the requirements for development of real-time displays; the psychological aspects of 
design such as the layout, color selection, real-time response rate, and interactivity of displays; and an 
analysis of some existing WATR displays. 


17. Key Words (Suggested by Author(s)} 


18. Distribution Statement 

Unclassified — Unlimited 


Human-computer interaction Unclassified — Unlimited 

Human factors 

Real-time interactive displays 
Western Aeronautical Test Range Subject cat egory 53 


19. Security Classif. (of this report) 20. Security Classif. (of this page) 21. No. of pages 

Unclassified Unclassified 14 


NASA FORM 1826 OCT 86 

*For sale by the National Technical Information Service, Springfield, VA 22161-2171. 


21. No. of pages 22. Price 













